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ABSTRACT 



A method and apparatus for processing image data of pixels 
to be rendered for efficient storage in a memory or efficient 
transmission wherein a grey level value of a rendered pixel 
is represented by multiple bits including a most significant 
bit (MSB) and a least significant bit (LSB). The method and 
apparatus provide for modifying of the density values of 
successive pixels in accordance with an error diffusion 
operation. The modified density values are then subject to a 
thresholding operation wherein the thresholding operation 
employs position of a pixel to detennine the digital value of 
the LSB of the rendered pixel. There is thereby provided a 
pattern structure to the LSB data. The rendered pixel values 
may then be compressed to provide for efficient storage in a 
memory or for efficient transmission over a communication 
pathway. The invention thus relates to improving the com- 
pressibility of the total image data by imparting structure to 
at least rendered image data where the error diffusion 
process would normally remove any structure to the LSB's 
of the image. 

15 Claims, 9 Drawing Sheets 
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METHOD AND APPARATUS FOR 
INCREASING COMPRESSIBILITY OF 
MULTTBIT IMAGE DATA WITH THE LSB 

VALUE DETERMINED IN THE 
THRESHOLDING OPERATION BASED ON 
PIXEL POSITION 

FIELD OF THE INVENTION 

Hie present invention relates to apparatus and methods 
for processing of grey level image data for efficient storage 
in a memory or for efficient transmission of the data. 

DESCRIPTION RELATIVE TO THE PRIOR ART 

In the prior art it is known to use non-impact recording 
apparatus that employ laser, LED, thermal, ink-jet or other 
recording sources for respectively recording images on an 
appropriate medium by forming picture elements (pixels) of 
varying grey shades. Typically, the recording apparatus 
includes image processing means for generating a multibit 
image digital signal (MIDS) for each pixel to be recorded. 
In response to each MIDS, a pixel of a corresponding size 
or density is recorded on the medium and a number of pixels 
in the aggregate comprise a recording image that may be 
viewed or transferred to another medium for viewing. The 
recording apparatus may form a part of a copier wherein a 
maltipage document to be copied includes an image scanner 
to transform the images on the document to electrical signals 
representative thereof. If multiple copies of the document 
are to be made and printed in collated order without more 
than one scan of each page of the original, it may be 
necessary for the copier to store the image data for all of the 
pages of the document. Where the stored data is more than 
one bit per pixel, such storage requirements may be exces- 
sive because of limited available memory. 

In U.S. Pat No. 5,384,646, there is described an apparatus 
wherein the multibit image data is separated into separate bit 
planes for storage. For example, where the MIDS is a 
two-bit signal the least significant bit (LSB) and the most 
significant bit (MSB) portions of the signals are separated 
and separately compressed, stored and then expanded. 
Eventually, the separate bits are brought together for use in 
printing and defining a grey level of a pixel to be recorded. 

A problem with the above is that in rendering certain 
images, improved results can be obtained using a rendering 
technique involving error diffusion. The concept of error 
diffusion results from the recognition that quantization 
errors are introduced in a thresholding rendering operation 
and mat these errors may be corrected by distributing errors 
introduced in rendering prior pixels to a current pixel being 
rendered. Error diffusion images by their very nature have 
minimal, if any, structure. As a consequence, error diffused 
image data (in general) do not compress very well. T he LS B 
pl ane of a multibit error diffused image tends to com press 
very poorly. Known compression encoding schemes or 
aigonthms operate well upon data that have detectable 
structure. The schemes such as Q-coder and Lempel Ziv 
adapt compression to the underlying structure in the data 
signal. They do this in different ways. Q-coder is a known 
implementation of arithmetic coding. With arithmetic 
coding, the entire sequence of input symbols (i.e., pixels) are 
mapped to a single code word (albeit a very long code word) 
This code ward is developed by recursive interval partition- 
ing using the symbol probabilities. The final code ward 
represents a binary fraction that points to the sub-interval 
determined by the sequence. The Q-coder is a binary com- 
pression scheme which utilizes an adaptive probability esti- 
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mator to predict the probability of an input symbol (pixel). 
Compression is significantly improved if the predicted prob- 
ability is skewed toward 0 or 1. Therefore, the introduction 
of predictable structure results in higher compression. One 
s method of utilizing the Q-coder is bit plane encoding in 
which the algorithm may operate upon strings of MSB* s, for 
example, the strings of other bit planes and then strings of 
LSB's. 

Lernpel Ziv is also an adaptive program but creates a 
10 dictionary of code based on patterns of bits that have been 
processed, and when the pattern appears, its pattern is 
"looked up" in the dictionary and a compressed code sub- 
stituted far the pattern. Where there is minimal structure in 
the image, data compression is poor and this affects seri- 
15 ously the amount of data that can be stored. Lernpel Ziv 
schemes typically, do not separate and compress individual 
bit planes. 

It is, therefore, an object of the invention to provide a 
method and apparatus for processing image data that pro- 
20 vides for increased compressibility of rendered image data. 

SUMMARY OF THE INVENTION 

The above and other objects which will become apparent 

25 after reading this disclosure are realized by a method of 
processing image data of pixels to be rendered for efficient 
storage in a memory or for efficient transmission over a 
communication pathway wherein a grey level value of a 
rendered pixel is represented by multiple bits including a 

3Q most significant bit (MSB) and a least significant bit (LSB), 
said method comprising the steps of modifying the density 
values of successive pixels each in accordance with diffu- 
sion of errors in rendering of adjacent pixels to farm far said 
pixels modified density values; generating for each of said 

35 pixels a multibit digital signal that represents a rendered 
pixel value by subjecting the modified density value to a 
thresholding operation wherei n the thresholding op eration 
emplo ys position of a pixen^determm cJhe-dtgital value of 
the ISB of the pixel; and encoding the rendered pix el values 

^ to compress image data representing the rendered pixel 
values. 

In accordance with another aspect of the invention, there 
is provided an apparatus for processing image data of pixels 
to be rendered for efficient storage in a memory or for 

4S efficient transmission over a communication pathway 
wherein a grey level value of a rendered pixel is represented 
by multiple bits including a most significant bit (MSB) and 
a least significant bit (LSB), said apparatus comprising 
means for modifying the density values of successive pixels 

30 each in accordance with diffusion of errors in rendering of 
adjacent pixels to form for said pixels modified density 
values; rendering means for generating for each of said 
pixels a multibit digital signal that represents a rendered 
pixel value by subjecting the modified density value to a 

55 thresholding operation wherein the thresholding operation 
employs position of a pixel to determine the digital value of 
the LSB of the pixel; and means for encoding the rendered 
pixel values to compress image data representing the ren- 
dered pixel values. 

60 BRIEF DESCRIPTION OF THE DRAWINGS 

In the detailed description of the preferred embodiment of 
the invention presented below, reference is made to the 
accompanying drawings in which: 
63 FIGS. 1A and IB are schematics of document copiers that 
are modified to include image processing in accordance with 
first and second embodiments of the invention; 
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FIG. 2 arc tables of data that may be used in a conven- With reference to FIG. 3, error diffusion is performed by 

tional error diffusion image processor for rendering image considering the curr ent density value X and genera ting a 

data; modified density valu e by adding errors occurrin g in ren- 

FIG. 3 illustrates a typical error diffusion process; feting of prior neighboring pixels a, b, U,~b an d G. 

FIGS. 4A and 4B are tables of dam that are used in one 5 1Vp W these errors are weighted by multiplying each by 

V j. * ™ . . u»«i in uuc a smtable coefficient so that errors in pixels closer to pixel 

e^odiment of an error diffusion image processor for rcn- x havc affect on adjustments to modify pixel X. 

denng image data in accordance with the invention; ^ ^ dimension kernel illustrated in FIG. 3 is merely 

FIG. 5 illustrates a pattern of LSBs of rendered image data exemplary and the invention is not n™ft^ to any particular 

in accordance with the tables of FIGS. 4A and 4B; 1Q error diffusion kernel or algorithm. 

FIG. 6 is a flowchart of a rendering process associated Thus, element 40 shown in the schematic of PIG. 1A 

with the rendering pattern of FIG. 5; includes memory far storing errors ofprior rendered pixels 

FIG. 7 illustrates a pattern of LSBs of rendered image data m me neighborhood (kernel) of the current pixel X and 

also in accordance with the tables of FIGS. 4A and 4B but provides for multiplication of the errors in accordance with 

in another embodiment of the invention; 15 a suitable programmed coefficient The sum of the weighted 

FIG. 8 illustrates a flowchart of a rendering process errors arc then added in an adder 30 with the current density 

associated with the rendering pattern of FIG. 7. value to define an 8-bit modified density value that is subject 

to thresholding by a grey level thrcsholder. The current 

DESCRIPTION OF THE PREFERRED density value is also input to element 40 so that error may 

EMBODIMENTS 20 be determined in rendering of the current pixel for distribu- 
tion to subsequent current pixels. In typical grey level error 

Because apparatus of the type described herein are in diffusion* the density values having ranges in column A of 

general well known, the present description will be directed FIG. 2 are assigned 4-bit rendered pixel values indicated in 

in particular to elements forming part of or cooperating more column C of FIG. 2. The elements 30, 40 and 50 may be 

directly with the present invention. Apparatus not specifi- ^ realized by a general purpose computer or programmed 

cally shown or described herein are selectable from those microcomputer or a programmable logic circuit or dedicated 

known in the prior art. circuit Details regarding programming of such computer or 

The invention will fast be described with reference to microcomputers are well known and generally within the 

conventional processing of image data. Thereafter, the skill of the art In addition, logic performing circuits and 

description will provide disclosure of modifications to this so their construction are also well known, 

processing that in accordance with the invention provide for In the preferred method and apparatus of FIG. 1A, after 

improved compression of rendered image data. thresholding, the 4-bit rendered pixel value is separated into 

With reference now to FIG. 1A, there is shown a sche- its various bit planes (note, the intermediate bit planes and 
matic of a recording apparatus that includes a document processing therefor are not specifically shown). The bit 
scanner 20 which scans a document say at 600 dots per inch 35 planes of the rendered data for the various rendered pixels 
and outputs for each scanned pixel area an 8-bit signal are separately encoded or compressed using an adaptive 
representing grey level values from 0 to 255 of rasterized compression algorithm by a compression device 70^-7^ 
image data. Scanners of this type are well known and are such as Q-coder or Lempel-Ziv, for example and then stored 
provided with suitable electronic circuitry for correcting for in compressed form in memories 80j-80 4 . Where the scan- 
background of the document and other factors not associated 40 ner document is part of a multisheet document, plural 
with the present invention. Since the scanner defines a pixel document sheets may be scanned by scanner 20 so that the 
to be recorded with 8-bits of density data whereas the printer memories 80 x -80 4 may be used to provide data for printing 
records at say 15 levels of grey that can be defined with collated sets of the multisheet document without having to 
4-bits of data there is a need to render the data; Le., scan the multisheet document more than once. As is known, 
transfor m the scanner output data to a form suited fox that of 45 the data is read or output from the memories for printing and 
the printer. Id the rendering process there is typically pro- returned thereto for use in printing of the next set In 
vided a thresholding operation. Fox example, and with outputting data for printing, the compressed data is 
reference to the table of FIG. 2, 8-bit density values of 0 to expanded back to rasterized data by an expansion processor 
15 maybe rendered as pixel grey value 0; density values 90 t -90 4 and output to page buffers lOO^lOO^ When the 
16-31 maybe rendered as pixel grey value 1, etc. Since there so next line of data is to be output to the printhead 120 and 
is a range of density values for which a rendered value may assuming an LED (light-emitting diode) printhead is used 
be assigned, it is convenient to assume that the midpoint of the data for each pixel may be stitched together and input to 
the range is the accurate rendition point and that quantiza- a table 110 for unif oxmity correction. The corrected data can 
tion errors are defined from this midpoint range. Thus, a then be used for exposing say an electrostatically charged 
density value of 16-31 has a midpoint of 24. A density value 55 photoconductive web or drum or other photosensitive ele- 
of 31, when rendered as pixel grey value 1, has an assigned ment that is part of a marking engine 130 for recording a 
error of +7. Similarly, for density values in the range 32 to grey level at each of plural appropriate points of an image 
47 and rendered as pixel grey value 2, the quantization error recording member to form an image. Details of this marking 
represents the difference between the density value and the engine portion of the apparatus are not essential to an 
midpoint (40) with the appropriate sign. The use of the 60 understanding of the invention as the invention may be used 
midpoint density is generally provided for except at the with various forms of marking engines suited for non-impact 
extremes; i.e., density values 0-15 rendered as pixel value 0 printing in general 

are deemed to have error measured from 0 and density As noted above, adaptive compression processes work 

values 240-255 and rendered as grey level pixel values 15 best when there is underlying structure to the image data, 

are deemed to have error measured from 255. These values 65 Since error diffusion tends to reduce any structure that may 

from which errors are calculated are listed in the table of be in the data, the use of adaptive compression processes are 

FIG. 2 as the error array (column B). deemed not well suited for error diffused data. In accordance 
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with the invention, we have recognized that in an error algorithm or both. Preserving the LSB plane of a multibit 
diffusion process, structure may be forceably imparted to the image preserves the higher image quality attainable with 
thresholded image data so that relatively high compression multibit images. Improving the compressibility of the LSB 
ratios may be obtained by adaptive compression processes. allows the system to preserve the high image quality while 

The description of how this farcing of the data is provided 5 a t me same time irnproving the compressibility of the image, 
will now be described in conjunction with FIGS. 1 and Where four or more bit planes are used, the two lowest 
FIGS. 4A, 4B, 5 and 6, it being assumed that the apparatus significant bit planes may be forced to attain structure in 
of FIG. 1 is now modified and programmed to operate in acconlance ^ ^ teachings herein, 
accordance with the disclosure provided below. _ . . . ~r . . 

Tir*t. c * cm r a. • n j ^ « A The invention is not just limited to forcing structure upon 

With reference to FIG. 5, there is illustrated a pattern 150 , n TPT1 . , . + ~. . . . Al _ * , „ *L 

_r jj/j i\ j • i • u • i 10 LSB planes alone but could include other bat planes, too. For 

of odd (d^) and even (hghO pixels n. eachp«cl row from ^ ^ ^ ^ 

^1?^ t this sketch, eight rows Rl-*8, of pixds ; are ££ m ^ed to be faced into a pattern of bits, there 

illustrated In each row an odd pixel will be rendered in r 1JL . 4 x . , , r , , , . 

accordance with the table of FIG. 4A. Note that as before the 4 ^ftte of P" el l ™ h each tobc 

density of a pixel to be rendered may be any value from would have about half again as rnany values as the acample 
a ^/rpLj u *™ 1 Ait* ■ tt _ 15 just provided above. A pixel could only be assigned a new 

0-255. This holds true even after error diffusion. However, J . . ^ w u- *u * • • T^, c 

^ - ^ , . - . — . * . » a * « pixel value after thresholding that is in a particular one of 

note that rendered pixel values for the odd pixels in the row *. m A „ , . J „„,„,,, . 

. - _ -—^ , , A » ■ . , these 4 tables, lne next pixel would receive assignments 

have .the samel^B ^alue (excetrt for rendered pael value 0) ^ ^ seoon / OJlc of lhcse fahlcs ^^ere 

rf ? . * ^ * , ' ^ ^ would order to the bits in the two least significant bit 

spending to the rendered pixel values are also indicated in 20 v ^ ancs 

binary coded form. Similarly, as may be noted in FIG. 4B, . 
all rendered even pixels in each row are rendered so that the ^ invention has thus shown that there is an mterrela- 
rendered pixel value for each pixel is such that the LSBs are ttonship between rendering and compressing within the 
all digital "0" (except for rendered pixel value 15). Thus, it *ata. ™ e b ?* c ° f inve ^° a 

is apparent that thresholder 50 is programmed to provide „ a rendermg algorithm operating on error diffused image 
selective different thresholding to odd and even pixels so be modified in such a way as to improve the compress- 

that the LSBs are provided with an induced structure. An lbflity of the LSB planes in order to significantly improve the 
adaptive compression program will advantageously run effi- compressibility of the total image data by imparting struc- 
ciently to compress this data, and in particular, improvement *»« me €XI0T diffusion process would normally 

will be noted in compressing the LSBs after error diffusion. ^ remove such structure. 

The flowchart of FKj. 6 illustrates steps in the operation of By forcing structure into the LSB plane(s) patterns for 
the process of the invention which is repeated for each pixel LSBs of incoming new pixel values to the compressor are 
although in practical operation steps for rendering the entire highly predictable. Because there are compression algo- 
multipage document may be performed before outputting rithms that are adaptable or prograrnmable to recognize 
any rendered image data to the printer for printing see in this 3J patterns in data and employ relatively high compression 
regard the disclosure of U.S. Pat No. 5384,646, the con- ratios to bit patterns that are recognizable a relatively high 
tents of which are incorporated herein by reference. compression can be expected of this data. 

With reference now to FIGS. 7 and 8, there is shown a The reason that error diffusion is of importance here is 
further example of forcing the rendered image data to have that by forcing more errors into the rendering process; i.e., 
structure suited for compression. In FIG. 7, a checkerboard w in creating new pixel values from limited ranges of values; 
pattern of structure 170 is imparted to the LSB bit plane of the error diffusion process can make up for these errors so 
rendered pixel values. The tables in FIGS. 4A and 4B are that appearance of the image is only minimally affected but 
also suitable for accomplishing this and FIG. 8 is an illus- compressibility is significantly improved, 
trative flowchart of the process. To generate a checkerboard Although the image data described herein is provided by 
pattern, consideration is given to row as well as pixel 45 a document scanner the invention contemplates that such 
position (column) in the row. Thus, pixels in odd rows and data may be generated from a computer, and/or word 
odd columns and pixels in even rows and even columns tend processor, facsimile or generally a source of electronic or 
to be formed with the LSBs as digital "Is" whereas all other digitized information. In addition rendered data in accor- 
pixels tend to be formed with digital **0s M . dance with the invention may be output to other recording 

With this invention, the possible pixel values which a 50 devices, in addition to printers, such as displays or output to 
pixel can take is dependent on pixel position. In this way, the storage devices serving as electronic memories. In addition 
pixel levels can be selected such that the LSB can occur to while the schematic of FIG. 1A illustrates separate corn- 
match some specific pattern. The appropriate assignment of pression devices for compressing separate bit planes the 
threshold and error arrays allows the algorithm to automati- invention contemplates mat a single compression device 
cally track the correct gray level (ie., it stfll works properly 55 may be provided for serially operating on the rendered pixel 
or it is mean preserving because of the feedback nature of an data of separate bit planes and storing this data efficiently in 
error diffusion algorithm). This pixel pattern can then in turn a single memory or providing for efficient transmission of 
be learned by the arithmetic coding algorithm or any com- the data over telephone lines, networks such as LANs, and 
pression algorithm which is capable of improving compres- other commu nication pathways. 

sion by learning patterns. For an arithmetic coder, this is go In accordance with a second embodiment of the 
accomplished by selection of an appropriate context One invention, an apparatus 10* is illustrated in FIG. IB wherein 
such pattern, as has been shown, is alternating pixel posi- similar parts to that shown in FIG. LA are identified with 
dons Another such pattern is a checkerboard. However, similar reference numbers. In apparatus 10', a compression 
these patterns are only preferred examples. device 70 does not operate on separate bit planes. The 

The specific pattern to be used can be optimized to meet 65 compressed data is stored in a memory 80 and expanded by 
the limitations and requirements of the marking engine or expansion processor 90. The expansion processor outputs 
the specific adaptive learning properties of the compression the data for storage in a page buffer 100 for printing as 
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discussed above, ox alternatively, the compressed data may 5. Hie method of claim 1 and wherein the thresholding 

be output to a LAN or other communication pathway for operation provides an LSB plane with an alternating pattern 

efficient transmission. In the embodiment of FIG. IB, ren- of digital l's and O's. 

dered pixel data has structure imposed at least upon the <>• The method of claim 1 and wherein the encoding 

LSB's of the data in accordance with the description pro- 5 operates on symbols representing multibit pixel data from 

vided above. However, in this embodiment, complete grey plural pixels. 

level data for plural pixels are packed together to form a 7. The method of claim 1 and including the step of storing 

symbol prior to input to the compressor 70. Thus, a symbol the compressed image data in a memory, 

may be formed from packing , together as a symbol byte * ^ mc * od of chum 1 1 ^including the ste P s . of 

renderedimage data of, for example, two pixels at 4-bits per 10 the compressed image data over a commumca- 

for input to the ^essor device 70. Because the ™* atus fof ^ ^ ^ ^ pixds to ^ 

LSB s of me r^der<^ data have structure imposed thereto, rendered £ ^ or f 0T 

the compressibility of the rendered image data is enhanced. transmission over a communication pathway wherein a grey 

The invention has been described in detail with particular level value of a rendered pixel is represented by multiple bits 

reference to preferred embodiments thereof, but it will be 15 including a most significant bit (MSB) and a least significant 

understood that variations and modifications can be effected bit (LSB), said apparatus comprising: 

within its spirit and scope of the invention. means far modifying the density values of successive 

What is claimed is: pixels each in accordance with diffusion of errors in 

1. A method of processing image data of pixels to be rendering of adjacent pixels to form for said pixels 
rendered for efficient storage in a memory or for efficient 20 modified density values; 

transmission over a communication pathway wherein a grey rendering means for generating for each of said pixels a 
level value of a rendered pixel is represented by multiple bits multibit digital signal that represents a rendered pixel 
including a most significant bit (MSB) and a least significant value by subjecting the modified density value to a 
hit (LSB), said method comprising the steps of: thresholding operation wherein the thresholding opera- 
modifying the density values of successive pixels each in 23 ti ° n ^fS^F^^jf * ^ t ^ ctcrminc *W* 
accordance with diffusion of errors in rendering of v U ^ !r ? "ie pixel, ana 
adjacent pixels to form for said pixels modified density ™ ms fo1 ^oding the rendered pixel values to compress 
values- * image data representing the rendered pixel values. 
. * ... Ik The apparatus of claim 9 and including means for 
generating for each of said pixels a multibit digital signal ^ dividing rendered image data for successive pixels into bit 
that represents a rendered pixel value by subjecting the planes. 

modified density value to a thresholding operation u. The apparatus of claim 9 and wherein the rendering 

wherein the thresholding operation employs position of means provides an LSB plane with a checkerboard pattern of 

a pixel to determine the digital value of the LSB of the digital l's and O's. 

pixel; and 35 12. The apparatus of claim 9 and wherein the rendering 

encoding the rendered pixel values to compress image means provides an LSB plane with an alternating pattern of 

data representing the rendered pixel values. digital l's and O's. 

2. The method of claim 1 and wherein the thresholding 13. The apparatus of claim 9 and wherein the means for 
operation employs position of a pixel to determine the encoding operates on symbols representing multibit pixel 
digital values of the LSB and the bit next to the LSB of the 40 data from plural pixels. 

pixel. 14. The apparatus of claim 9 and including a memory for 

3. The method of claim 1 and wherein the rendered image staring the compressed image data. 

values for successive pixels are divided into bit planes. 15. The apparatus of claim 9 and including a cttmmuni- 

4. The method of claim 1 and wherein the thresholding cation pathway for transmitting the compressed image data, 
operation provides an LSB plane with a checkerboard pat- 
tern of digital l's and O's. * * * * * 
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